Quasiparticle Interference on the Surface of the Topological Insulator Bi 2 Te 3 
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The quasiparticle interference of the spectroscopic imaging scanning tunneling microscopy has 
been investigated for the surface states of the large gap topological insulator Bi2Te3 through the T- 
matrix formalism. Both the scalar potential scattering and the spin-orbit scattering on the warped 
hexagonal isoenergy contour are considered. While backscatterings are forbidden by time-reversal 
symmetry, other scatterings are allowed and exhibit strong dependence on the spin configurations of 
the eigenfunctions at k points over the isoenergy contour. The characteristic scattering wavevectors 
found in our analysis agree well with recent experiment results. 
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I. INTRODUCTION 

The theoretical proposal^ and experimental discov- 
ery of the topological insulators^— have provoked an 
intensive research effort in condensed matter physics. 
Topological insulators (TI) with time-reversal symme- 
try are generally characterized by a topological term in 
the electromagnetic action with a quantized coefficient 4 . 
These states have been theoretically predicted and ex- 
perimentally observed in both two and three dimen- 
sions, including the two-dimensional (2D) HgTe/HgCdTe 
quantum wells 1,9 , and bulk three-dimensional materials 
Bi 2 Te 3 , Bi 2 Se 3 and Bi^Sb^&iSri^ They exhibit ro- 
bust gapless modes at boundaries, e.g. a ID helical edge 
mode for 2D TIs, and a 2D helical surface mode for 3D 
TIs with odd numbers of Dirac cones. Due to time rever- 
sal symmetry, backscattering is forbidden for the helical 
edge and surface states, and an analysis of interaction ef- 
fects for the ID helical edge modes shows they are stable 
against weak and intermediate strength interaction !] 14 i 15 . 
Bi2Te3 and Bi2Se3 have been predicted to have bulk band 
gaps exceeding room temperature 8 -, which makes them 
promising for future applications. 

Zhang et al predict that the surface states of Bi2Te3 
consist of a single Dirac cone at the Y point, and that 
the Dirac cone evolves into a hexagonal shape at higher 
energy 8 . Furthermore, near the Dirac point, the spin of 
the electron lies perpendicular to the momentum. Angle- 
resolved photo-emission spectroscopy (ARPES) measure- 
ments performed on the surface of Bi2Te3 have confirmed 
these predictions in detai l 12 ' 16 . The typical shape of 
the Fermi surface is a snowfiake-like warped hexagon. 
The low-energy 0(2) symmetry of the Dirac cone is bro- 
ken due to the Cz v symmetry of the underlying lattice 8 -, 
and can be modeled by a warping term in the effec- 
tive modelii. Another powerful surface probe, spectro- 
scopic scanning tunneling microscopy (STM), is sensi- 
tive to quasi-particlc interference (QPI) around impuri- 
ties, and provides an important tool to study electronic 
structures in unconventional materials, such as high T c 



turn space through real space measurement with a high 
energy resolution. Recently, several groups have per- 
formed STM measurements on surface states of Bi2Tc3 
and Bii-^Sb; ,, 13 ' 20 " — . Backscattering induced by non- 
magnetic impurities between time-reversal (TR) partners 
with opposite momenta is forbidden due to their oppo- 
site spin configurations. This is confirmed by the real 
space Friedel oscillation pattern and by analysis of the 
QPI characteristic scattering wavevector. 

In this paper, we perform a detailed QPI analysis of 
the surface states of the topological insulator Bi2Te3. A 
general TR-invariant impurity potential including scalar 
and spin-orbit scattering components is studied using the 
standard T-matrix formalism. The scattering on the iso- 
energy surface strongly depends on the both momentum 
and spin orientation. Scattering between TR partners 
vanishes as a consequence of TR symmetry. The scat- 
tering is dominated by wavevectors which connect re- 
gions on the Fermi surface of extremal curvature, but also 
accounting for spin polarization. STM experiment o 20 ' 21 
have yielded rich information about the QPI structure. 
In addition to the absence of backscattering, the STM 
experiments also observed recovered scattering 2 ^ at a 
wavevector (k ne st in their, and q\ in our notation), and 
an extinction^ 1 - (i.e. near absence of scattering) (q 3 in 
their and our notation), both at wavevectors which do 
not connect TR states. Below, we offer a novel expla- 
nation of this experimental puzzle. Our results are in 
excellent overall agreement with the QPI experiment in 
Bi 2 Te 3 . 



II. SUFACE DIRAC MODEL WITH WARPING 
TERM 

The k ■ p Hamiltonian for the surface Dirac cone was 
first derived in Ref. [H The bare Hamiltonian is written 
as Ho = fd 2 k^{k)H(k)i>(k), where ^(k) = (cLct). 

With the addition of the cubic warping termi£, 
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It can provide information in momen- 



H{k) = v(k x a) ■ z + Xk 3 cos 30^ <r z 
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The azimuthal angle of k is <j)^ = tan -1 (k y /k x ), where 
the Y-K direction is taken as x axis. Following Ref. [I?], 
the quadratic terms are dropped since they do not signif- 
icantly change the shape of the constant energy contour, 
and the characteristic energy and wavevector scales are 
defined as: E* = vk c and k c = y/v/X. This Hamiltonian 
can be diagonalized by introducing 



/ cos(%/2) 
U(k) = 

\ ie^s sin(%/2) 




where tan#£ = k 2 /(k 2 cos3(p^). One then finds H(k) = 
E(k) U{k) a z W(k), with eigenvalues E± = ±E(k) where 



E(k) = J(vk) 



(Xk 3 cos36> £ ) 2 



(3) 



In fig. Ufa) we plot the isoenergy contour E = 1.5 E* , 
which qualitatively reproduces the snowflake Fermi sur- 
face observed in the first-principles calculation and the 
ARPES experimenta l 1 2 1 1 7 . As for the scattering process, 
we take 



d 2 kd 2 k' V % _p ^{k') 



. + ickx k' 



^(fc).(4) 



For a single short-ranged scatterer we may approximate 
Vg_g, ~ Vq. The second term corresponds to the spin- 
orbit scattering with the coefficient c describing its rela- 
tive strength to the potential scattering. It is convenient 
to project the potential onto the eigenbasis of Ho, so 



Vtfi 



Vq U f (k') l + ick x k' -a U{k) 



(5) 



For simplicity, we first consider the c = case (pure 
scalar potential scattering), returning later to the general 
spin-orbit case (c ^ 0). Since the spectrum is particle- 
hole symmetric, let us focus on a definite (positive) sign 
of the energy. The QPI will then be dominated by scat- 
terings inside the positive energy band, whose effective 
scattering potential is: 



: S cos 4- sin S sin 



(6) 

This effect also appears in the QPI analysis of the orbital- 
band systems where orbital hybridization brings strong 
momentum dependence to the scattering process^. 



III. EFFECT OF SPIN ORIENTATION ON THE 
QPI PATTERN 

The points of extremal curvature on the Fermi sur- 
face are divided into two groups, arising from the 'val- 
leys' (k = kh, positive curvature) and 'tips' (k = ku, 
negative curvature). We define the complexified points 
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FIG. 1: (Color online) (a)The iso-energy contour near the Y 
point for E = 1.5E* with snow-flake shape. The x and y axes 
are chosen to b e the Y-K and Y-M directions respectively, 
and k c = \/v/X. The red and brown (dark gray) dots refer to 
the valley and the tip points on the contour, and the arrows 
indicates six representative scattering wavevectors. kt and ku 
are solutions of E + (kL, 6 = 0) = E + (ku, = tv/2) = E which 
are the boundary of the truncation for the fc-integration used 
in this paper, (b) The spin orientations of the eigenfunctions 
for a+ band at valfey and tip points. The dotted fines refer 
to the mirror-symmetric lines (IVM), and the system has a 
three-fofd rotationaf symmetry. The arrow indicate the spin 
configuration in the xy plane and the solid circfe (cross) refers 
to S z being along +z (—z). At the cusp points the spin lies 
only on the xy plane while S z has the largest magnitude at 
the valley points with staggered signs. 
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kue 57ri /6 5 anc j y — }~ ue W 2 . Then from eqn. [5] we 

' — '^l 2 = ^sin^,|^| 2 = f -h^cos^, 

0, where A = —A, corresponding to scat- 
tering through the vectors q^, q\, and q\, respectively, 
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with tan$ = (fcc/fcz,) 2 - We also find Vj 
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0. These processes are de- 
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. u u — is a direct consequence of TR 
symmetry, the other processes through scattering vec- 
tors 92,3,5,6 are i n general finite. Their amplitude vari- 
ation may be understood in terms of the spin orienta- 
tion of the eigenfunctions throughout the Brillouin zone, 
S(k) = (— sin 8j: sin 0£ , sin 6^ cos 0£ , cos 6%), depicted in 
fig. [lib). Bi 2 Te3 has the symmetry of C^ v , i.e. three-fold 
rotational symmetry plus the three reflection lines (Y-M 
plus two equivalent lines). Therefore at the tips S z (k) 
must vanish since a z is odd under the mirror operation. 
S z (k) has the largest magnitude at the valleys, but with 
staggered signs, as shown in the figure. Since scalar po- 
tential scattering does not flip electron spin, its matrix 
element is largest when S(k) ■ S(k r ) is large and posi- 
tive, i.e. high spin overlap. This echoes the experimen- 
tal finding of Pascual et alM- that in the QPI pattern on 
Bi(110), only the scattering processes preserving the spin 
orientation are visible. One major difference, however, 
betwwen Bi(110) and Bi2Te3 is that the former has mul- 
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tiple Fermi surfaces and the scattering processes preserv- 
ing spin orientations do exist at finite q, while the later 
only has one Fermi surface and therefore no such scatter- 
ings could exist. At the tips, the spin lies in-plane, with 
9j: — ^, independent of the scanning energy E. It can be 

checked that S(k + q 5 ) ■ S(k) > S(k + <f 6 ) ■ S(k), hence 
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For scatterings between the valleys, 
S(k) ■ S'(k') depends crucially on S z {k) and S z {k'). Ac- 
counting for the valley-to- valley oscillation in S(k), we 
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conclude that as the scanning energy increases, \V j 

grows while | Vj^b | 2 shrinks. This simple argument gives 
a qualitative explanation for the absence of the q*3 scat- 
tering in the STM experimental. For typical experimen- 
tal parameters^, E/E* w 1.5 and khlk c ps 1. In this 
case we estimate the scalar potential scattering gives that 



\V, 



(ii) 



wx 



V. 



(11) 1 2 . | y (ll)|2 



AC 



AB 



(ii) 



WY 



6:5:3:2. 



IV. NUMERICAL RESULTS 

To specifically compute the QPI image, we employ a 
T-matrix approach 25 for multiband systems^. In the 
operator basis $(k) = U(k) ip(k), the Green's function is 
written in matrix form as 

G(k,k',u) = G (k,uj)S u ,+G (k,Lj)f^,(u;)G (k',(j) 

(7) 

where the T-matrix satisfies 
-72 



T %,%M = %< + Jd'pV^G (f, U )T RP ( U ) , (8) 

and [Go,<x(fc, w)] ab = [lo + iS — E a (k)\ 5 at b are the bare 
Green's functions. In spectroscopic imaging STM—, the 
conductance (dl/dV) measured by the STM is propor- 
tional to the local density of states defined as 



(9) 



where p a (f,oj) — ImG (J (r, r, tu) is the local density of 
states for spin a. The QPI image in the Brillouin zone 
p(q, lu) is then obtained by performing the Fourier trans- 
formation of the conductance dl/dV. As a result, we can 
calculate p(q, tu) using the T-matrix formalism by: 

p%u) = fd 2 re^p(r,u) 



2i 



d 2 kJr 



U(k)G(k~,k + q,Uj)U^(k + q) 



- (ti{k) G(k, is-M U\k - q)) ' 



(10) 



where the trace is taken with respect to the matrix index. 
Because physically STM measures the local density of 
states in the spin basis of ijj(k), while our T-matrix theory 



here is developed in the eigenbasis of &(k), the SU(2) 
rotation matrices U(k) are introduced in the last line 
of eq. [10] to transform back to the physical spin basis. 
Because the first term in eq. [71 p(q — 0) contains the 
sum of the total density of states without the impurity, 
which makes it much larger than p(q ^ 0), we only plot 
\p(q 7^ 0)| in order to reveal weaker structures of the QPI 
induced by the impurity scattering. 

We solve eq. [^numerically, using 2D polar coordinates. 
Since the dominant scattering processes are between k 
points on the constant energy contour E + (k, 9) = E (we 
focus on E > here), we perform the integration within 
the range k^ < k < kjj with k^ and kjj indicated in 
Fig. [Ua). The resulting QPI images are plotted in fig. 
[5] for c = with E = 1.5 E* fixed. For this choice of pa- 
rameters, khjk c — 1.029 and kjj/k c = 1.5. As shown in 
fig. (2Ja), Q5 and q-2 indicated by the red (dark gray) and 
green (light gray) circles are the strongest features while 
g*3 (indicated by the white circle) is almost invisible. The 
reason why 9*5 is even stronger than 52 while they have 
comparable scalar scattering potential is due to the dif- 
ference in the density of states. Because the tip points 
shown in fig. [lja) have larger density of states than the 
valley points, the weights of cfs is larger than those of 52, 
resulting in the stronger features observed for q§. The 
strong features near q = correspond to small q scatter- 
ings around the tips and valleys points, which have also 
be seen in experiments. Our results reproduce satisfac- 
torily the experimental findings and are also consistent 
with the analysis from the spin-orientation selection rule 
discussed above. 

As the scanning energy increases further, the surface 
states along the T — M direction start to merge into the 
conduction band of the bulk states. In this case, the tips 
of the constant energy contour will be mixed up with 
these bulk bands, which weakens the cfs scattering but 
enhances the small q scatterings near the T point. This is 
consistent with the experiment 2 !, showing that the area 
of the strong features near T point becomes much larger 
after the scanning energy exceeds the bottom of the con- 
duction band. 



V. SPIN-ORBITAL SCATTERING IMPURITY 

Now we briefly comment on the effect of the spin-orbit 
scattering given in eq. 2] which in principle exists in any 
realistic system. Since surface states of the topological 
insulator Bi2Te3 are two-dimensional, the spin-orbit scat- 
tering potential only has one component: 



icV d 2 kd 2 k' tt'sin(fc - <j>A ip^(k') a z tp[k). 



■ijSO 

imp , 

(11) 

Backscattering is still forbidden because of the sm(<pp — 
4>^) factor. Although a z does not flip spin, the angle- 
dependence sin((j)p — 4>t) gives rise to an additional sup- 
pression beyond that from the spin-orientation selection 



4 



1 

-1 

-2 



O / 



-2 -1 



1 

TK 



2 


(b) 




1 






So 




-1 




-2 




9 



-2 -1 





TK 



FIG. 2: (Color online) The quasiparticle interference image 
for (a) c = and (b) c = 0.5 with E = 1.5 and Vo/E* = 
0.1. In this case, kL/k c = 1.029 and ku/k c — 1.5. (a) The 
strongest large <f scatterings are <fs and 52 indicated by the red 
(dark gray) and green (light gray) circles (and their symmetric 
points). Q3 (indicated by the white circle) is too weak to be 
seen, (b) For c = 0.5, new QPI features with large momenta 
are visible. 



rule discussed in the case of scalar impurity scattering. 
Moreover, because the matrix element is linear in kk', the 
spin-orbit scattering tends to enhance the scatterings be- 
tween quasiparticles with large momenta. All these ad- 
ditional effects due to the spin-orbit scattering can be 
roughly seen in a straightforward calculation froim eq. 
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Nonzero c brings in new interferences which could lead to 
unusual suppressions or enhancements for some scatter- 
ing wavevectors, depending not only on the magnitude 
and sign of c, but also on the scanning energy E. In 
fig- H^b) w e show the QPI image for c = 0.5. While 
the main features are still similiar to those of fig. HJa), 
new prominent features associated with larger momen- 
tum scatterings are visible. Since the matrix elements 
for spin-orbit scattering are larger for quasiparticles with 
larger momentum, this term will become more and more 
important as the scanning energy E increases. A detailed 
analysis of the spin-orbit scattering will be presented in 
a future publication. In comparison with the results in 
refi^i, we find that spin-orbit scattering from the impu- 
rity of the Ag atom is not very important in this partic- 
ular experiment. 



VI. CONCLUSION 

In conclusion, we have analyzed the quasiparticle in- 
terference induced by nonmagnetic impurities on the sur- 
face of the topological insulator Bi2Te3 using a T-matrix 
approach . While the backscattering is completely for- 
bidden by time-reversal symmetry, other scatterings are 
allowed, resulting in the QPI patterns observed in STM 
experiment o 20 ! 21 . We have shown further that the scat- 
tering strengths depends crucially on the spin orienta- 
tions of the eigenfunctions. Since nonmagnetic impurities 
can not flip spin, the scalar scattering potential between 
two eigenstates is larger as their spin overlap is larger. 
Combined with the variation of the density of states, we 
have shown that some of the scatterings might be too 
weak to be seen in comparison with the strongest ones, 
and our results successfully reproduce the QPI patern 
observed in experiments. We have further discussed the 
effect of the spin-orbit scattering on the QPI pattern. 
While the backscattering is still forbidden, we find that 
the spin-orbit scattering enhances several new features at 
large momentum, and the detailed QPI features strongly 
depends on the sign and strength of the spin-orbit scat- 
tering potential. 
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